Proceedings of the SIGIR 2009 Workshop on the Future of IR Evaluation
نویسندگان
چکیده
Evaluations in Information Retrieval are dominated by measures of precision and recall. Is that enough? Probably not, as it somewhat assumes that all information seeking tasks are equal, and that everyone needs the same thing. In this position paper, we advocate a consumers’ guide to systems that aim at supporting information seeking tasks. We propose a method that provides guidance in whole-of-system evaluations, explicitly considering all participants and both sides of the “bang for buck” equation.
منابع مشابه
Workshop on Contextual Information Access, Seeking and Retrieval Evaluation
There are three parts to this talk – related in rather tangential ways. First, I will give a recap of an argument developed in a couple of earlier talks – at IIiX in 2008 and at the SIGIR evaluation workshop in 2009. The gist of the argument is about thinking about IR as a science, and the consequences Appears in the Proceedings of The 2nd International Workshop on Contextual Information Access...
متن کاملSIGIR WORKSHOP REPORT Crowdsourcing for Information Retrieval
The 2nd SIGIR Workshop on Crowdsourcing for Information Retrieval (CIR 2011) was held on July 28, 2011 in Beijing, China, in conjunction with the 34th Annual ACM SIGIR Conference1. The workshop brought together researchers and practitioners to disseminate recent advances in theory, empirical methods, and novel applications of crowdsourcing for information retrieval (IR). The workshop program in...
متن کاملReport on the SIGIR 2016 Workshop on Neural Information Retrieval
The SIGIR 2016 workshop on Neural Information Retrieval (Neu-IR) took place on 21 July, 2016 in Pisa. The goal of the Neu-IR (pronounced “New IR”) workshop was to serve as a forum for academic and industrial researchers, working at the intersection of information retrieval (IR) and machine learning, to present new work and early results, compare notes on neural network toolkits, share best prac...
متن کاملSIGIR WORKSHOP REPORT Information Retrieval and Advertising
The Information Retrieval and Advertising Workshop (IRA 2009) was held on July 23, 2009 in Boston, Massachusetts, in conjunction with the 32nd Annual ACM SIGIR Conference. The workshop covered theoretical and empirical issues in several research areas that span the intersection of computational advertising, information retrieval, and economics. The workshop consisted of 3 invited talks, 6 refer...
متن کاملSIGIR Announces Member Plus Program
SIGIR is offering a new membership class beginning July 1, 2000. The new "Member Plus" membership package includes conference proceedings from three conferences sponsored by ACM SIGIR: The Member Plus package also includes the benefits of "Basic" membership, such as SIGIR Forum and reduced registration fees at the SIGIR conference. Member Plus membership is an inexpensive method of staying abre...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009